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1.  INTRODUCTION 


Prostate  cancer  is  the  second  leading  cause  of  cancer  death  and  the  most  common  cancer  detected  in  men  in 
the  United  States.  Radical  Prostatectomy  (RP)  is  a  surgical  procedure  with  a  goal  of  complete  cancer  resection. 
Open  radical  prostatectomies  are  associated  with  loss  of  blood  and  lengthy  recovery  times.  Laparoscopic  radical 
prostatectomies  (LRP)  have  a  very  steep  learning  curve,  lack  3-D  visualization  and  use  rigid,  stick-like 
instruments  which  hinder  the  dissection.  A  third  technique  has  recently  emerged;  laparoscopy  using  the  daVinci 
Surgical  System  (Intuitive  Surgical,  Sunnyvale,  CA).  The  surgical  robot  introduces  many  benefits,  including 
three-dimensional  visualization,  higher  magnification,  hand  tremor  elimination  and  refined  dexterity  by 
incorporating  wristed  instrumentation.  Robotic-assisted  laparoscopic  prostatectomy  (RALP)  strives  to  maximize 
tumor  resection  and  nerve  preservation  and  it  has  rapidly  become  the  preferred  surgical  approach.  Recent 
studies  have  showed  RALP  is  a  feasible  procedure  with  a  short  learning  curve,  limited  blood  loss,  less  post- 
ostoperative  pain,  favorable  complication  rates,  and  short  hospital  stay.  The  lack  of  tactile  feedback  is  however, 
one  theoretical  disadvantage  that  has  been  raised  with  regards  to  robotic  surgery.  There  is  a  need  for  real-time 
intraoperative  guidance  in  laparoscopic  prostatectomies.  Hence  the  objective  of  this  proposal  is  to  develop  such 
a  capability.  Ultrasound  Elastography  (USE)  is  a  technology  which  can  be  integrated  with  the  robotic  probe. 
Elastography  is  ideal  as  a  technology  as  it  allows  for  real-time  acquisition  of  images  of  the  prostate  gland  and, 
similar  to  human  palpation,  allows  for  contact  based  interrogation  of  the  prostate’s  surface  [1].  USE  is 
affordable  and  minimally  invasive  and  can  also  be  miniaturized  and  incorporated  into  robotically  assisted 
prostatectomy.  USE  using  a  laparoscopic  ultrasound  probe  (LAPUS)  can  help  the  surgeon  visualize  the 
anatomy  of  the  prostate  gland,  identify  the  contours  of  the  cancerous  tumors  as  well  as  any  extra  capsular 
extension.  The  contribution  of  the  proposed  research  project  is  that  it  will  allow  for  real-time  intraoperative 
acquisition  of  images  of  the  prostate  gland  and  the  surrounding  tissues.  We  are  proposing  a  safe,  simple  and 
robust  technique  for  direct  interrogation  of  the  prostate  surface  aided  by  a  laparoscopic  US  probe.  USE  will  be  a 
valuable  tool  in  the  identification  of  cancerous  lesions  and  the  trajectory  of  cavernous  nerves  and  thus  improve 
the  chances  for  a  cancer-free,  nerve-sparing  outcome. 

2.  BODY 

This  report  will  address  each  of  the  tasks  we  proposed  to  accomplish  in  the  Statement  of  Work  as  outlined  in 
Table  1. 


Year  1 

Year  2 

Year  3  (9  months) 

Task  2.  System  Integration  and  Clinicai  Evaluation 

2a.  Iiitegiation,  testing,  pre-operative  plan 

2b.  IRB  approval 

2c.  Clinical  study  (N=  5-10) 

Task  3.  Design  and  build  new  LAPUS  probe 

3a.  Evaluate  data  from  clinical  study 

3b.  Design  and  build  New  LAPUS  probe 

3c.  Automatic  robotic-assisted  palpation 

Task  4.  Laparoscopic  Prostatectomy  with  Advanced  US  Imaging  Methods 


4a.  Probe  evaluation  -  phantoms 

4b.  Probe  evaluation  -  animal  models 

4c.  Cavernous  neiwes  imaging 

Table  1:  Statement  of  Work  for  Engineering  Tasks  2,3,4 


Last  year  in  the  first  annual  report  we  were  reporting  among  our  accomplishments  the  completion  of  tasks 
2a,  3c,  and  an  improvement  in  our  ultrasound  elastography  method  which  contributed  towards  accomplishing 


tasks  4a-c.  The  scientific  papers  supporting  these  accomplishments  have  been  published  in  their  final  form  in 
February  2012  and  are  attached  as  Appendix  1,  2  and  3  respectively: 

1.  Fleming,  L,  Rivaz,  H.,  Boctor,  E.,  Hager,  G.  “Robust  Dynamic  Programming  Method  for  Ultrasound 
Elastography\  Proceedings  of  SPIE  Medical  Imaging,  San  Diego,  CA,  February  2012  -  published  paper 

2.  Fleming,  L,  Rivaz,  H.,  Boctor,  E.,  Hager,  G.  “Robust  Dynamic  Programming  Method  for  Ultrasound 
Elastography\  Proceedings  of  SPIE  Medical  Imaging,  San  Diego,  CA,  February  2012  -  presented  poster. 

3.  Billings,  S.,  Nishikant,  D.,  Kang,  H.  J.,  Taylor,  R.,  Boctor,  E.,  "System  for  robot-assisted  real-time 
laparoscopic  ultrasound  elastography,"  Proceedings  of  SPIE  Medical  Imaging,  San  Diego,  CA,  February  2012 
-  published  paper 

At  the  end  of  the  first  year,  we  had  not  yet  achieved  tasks  2b  IRB  approval  (months  1-6)  and  2c.  Clinical 
evaluation  (months  6-12).  Having  been  experiencing  delays  in  the  submission  of  the  IRB  proposal,  out  team 
debated  how  to  best  accomplished  the  proposed  project  goals  in  the  time  left  available.  Our  goals  were  to 
evaluate  the  capabilities  of  the  Laparoscopic  Ultrasound  (LAPUS)  probe  (Figure  I)  in  imaging  prostate 
cancerous  tissue  and  also  to  prepare  for  clinical  testing  of  LAPUS  as  an  imaging  tool  during  robotic-assisted 
laparoscopic  prostatectomy. 


Existing  ultrasound  data  from  ex-vivo  prostate  specimens  (collected  recently  by  our  team  as  part  of  an  IRB 
approved,  ongoing  study)  were  used  to  asses  the  capability  of  a  standard  ultrasound  probe  Siemens  VFlO-5 
linear  array  with  similar  capabilities/transducer  with  the  LAPUS  probe.  N  =  6  prostate  specimens  from  patients 
enrolled  in  our  study,  provided  N  =  10  target  areas,  8  hard  nodules  in  the  peripheral  zone,  1  hard  and  1  soft 
nodule  in  the  central  part  of  the  gland.  Data  from  this  clinical  study  was  evaluated  (Task  3a)  and  the 
elastography  findings  compared  favorably  with  pathology  reports  and  MRI  findings  -  Figure  2  and  Table  2. 

Our  analysis  proves  that  an  ultrasound  probe  fitted  with  a  transducer  similar  with  our  LAPUS  probe,  can 
produce  elastograms  which  can  help  the  surgeon  identify  hard  and  soft  lesions  in  the  prostate  tissue.  We 
submitted  our  findings  and  our  paper  has  been  accepted  for  publication  in  the  Medical  Science  Monitor  Journal. 
The  final  proof  of  the  paper  which  will  be  published  in  the  upcoming  issue  of  the  journal  is  attached  to  this 
report  as  Appendix  4: 

loana  Nicolaescu  Fleming,  Carmen  Kut,  Katarzina  Macura,  Li-Ming  Su,  Hassan  Rivaz,  Caitlin  Schneider, 

Ulrike  Hamper,  Tamara  Lotan,  Russ  Taylor,  Gregory  Hager,  Emad  Boctor,  "  Ultrasound  elastography  as  a  tool 
for  imaging  guidance  during  prostatectomy:  Initial  experience" ,  Med  Sci  Monit,  2012;  18(9) 


Figure  2:  Coronal  section  of  prostate  specimen  #1  at  the  level  of  the  central  gland.  Classic  ultrasound  B-mode  (A)  and  elastogram 
(B).  9.4  Tesla  ex-vivo  (C)  and  3  Tesla  in-vivo  (D)  MRI  images  are  presented  in  coronal  planes,  in  CCW  (counter  clock  wise) 
orientation  for  better  visualization  of  the  correlation  between  USE  and  MRI  of  the  specimen.  Benign  solid  (arrow)  and  soft(dashed 
arrow)  nodules  and  urethra  are  visible. 


Table  2.  Prostate  specimen  data:  A  total  of  10  (ten)  elastography  lesions  were  identified  in  6  (six)  patients' specimens  (8  malignant  and  2  benign). 


# 

Location 

Gleason 

Size  (cm) 

score 

Elastography 

Pathology 

MRI 

1.1 

PZ  base 

3+5 

1. 4x0.8 

1. 3x0.8 

1.3X1.1 

1.2 

CG  base 

N/A-Solid 

O.Zxl.l 

I.Oxl.O 

I.Oxl.1 

1.3 

CG  base 

N/A-Soft 

1. 1x0.8 

I.Oxl.O 

1. 0x0.9 

2.1 

PZ  base 

5+3 

3.0x1. 3 

2.4X1.0 

2.0X1.5 

3.1 

PZmid 

4+5 

2.4X0.8 

1. 9x1.0 

1.5X1.2 

4.1 

PZmid 

3+3 

1. 0x0.5 

0.5X0.4 

0.6X0.7 

4.2 

PZmid 

3+4 

1. 5x0.9 

1. 1x0.5 

l.lxO.8 

5.1 

PZapex 

3+3 

0.5X0.6 

0.5X0.5 

0.6X0.6 

5.2 

PZapex 

4+3 

0.6x1. 0 

0.8X0.9 

0.9X0.9 

6.1 

PZ  base 

3+3 

0.7X1.2 

0.7X1.8 

0.7X0.7 

PZ  -  peripheral  zone;  CG  -  central  gland. 


Having  used  a  standard  ultrasound  probe  as  a  surrogate  for  the  LAPUS  probe's  capabilities,  we  still  had  to  evaluate  the 
ability  of  the  probe  to  access  and  interrogate  the  surface  of  the  prostate  in  a  robotic-assisted  approach.  For  our  goal  we 
employed  a  custom  made  prostate  elastography  phantom  (CIRS,  Inc.  -  Model  066).  The  phantom  was  modified  and  it's 
top  was  removed  to  allow  for  LAPUS  probe  access  and  imaging  through  direct  contact  -  Figure  3. 


Figure  3:  Modified  CIRS  066  Prostate  Elastography  phantom.  The  top  has  been  removed  and  direct  access  to  the  prostate-mimicking 
tissue  was  made  available. 


The  Model  066  contains  3  isoechoic  lesions  that  are  at  least  two  times  stiffer  than  the  simulated  prostate  tissue. 
Under  normal  ultrasound  they  cannot  be  detected  but  are  readily  visible  on  elastograms  -  Figure  4. 


SIDE  \nEW 


TOP  VIEW 


4.5cm 


2.6cm 


Figure  4:  Position  of  stiffer  lesions  inside  the  Model  066  phantom. 


We  attempted  to  image  the  lesions  inside  the  phantom  using  the  LAPUS  probe  is  comparison  with  a  transrectal 
ultrasound  (TRUS)  probe  -  Figure  5.  The  phantom  allows  for  rectal-like  examination  and  the  TRUS  probe  is  routinely 
used  in  practice  for  imaging  the  prostate  tissue  during  biopsies  and  sometimes  during  prostatectomies. 


Figure  5:  TRUS  probe  in  use  with  the  prostate  elastography  phantom. 


The  LAPUS  probe  presented  some  challenges  we  took  note  of,  particularly  its  length  appeared  big  with  respect  to  the  size 
of  the  prostate.  If  a  custom  probe  is  to  be  built  in  the  future  just  for  prostatectomy,  it  is  our  conclusion  that  is  should  be 
shorter  then  the  current  size  of  our  LAPUS  probe.  Even  though  the  size  presented  a  challenge,  we  were  able  to  image  a 
majority  of  the  prostate  mimicking  tissue.  Palpation  with  the  probe  was  needed  in  order  to  identify  the  stiffer  lesions  using 
our  elastography  algorithm  -  Figure  6. 


Figure  6:  Imaging  the  prostate  phantom  with  the  LAPUS  probe. 


Our  analysis  showed  that  LAPUS  was  just  as  capable  as  TRUS  probe  in  identifying  the  stiffer  lesions.  One  important 
thing  to  mention  is  that  in  order  to  obtain  elastograms  with  TRUS,  we  applied  compression  on  the  tissue  from  the  top, 
which  is  equivalent  to  palpating  the  prostate  during  prostatectomy.  Classic  B-mode  ultrasound  and  elastograms  obtained 
using  TRUS  are  presented  in  Figure  7,  and  the  corresponding  findings  using  LAPUS  are  shown  in  Figure  8.  Our  findings 
are  being  drafted  for  publication  for  the  Proceedings  of  SPIE  Medical  Imaging  to  take  place  in  Orlando,  FL  in  February 
2013. 
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Figure  7:  Elastogram  and  classic  B-mode  ultrasound  for  3  stiff  lesions  inside  prostate  phantom  Model  066  -  TRUS  probe  imaging 


Figure  8:  Elastogram  and  classic  B-mode  ultrasound  for  3  stiff  lesions  inside  prostate  phantom  Model  066  -  LAPUS  probe  imaging 

With  this  study  we  consider  accomplished  Task  4a.  For  the  remaining  9  months  of  our  fellowship  we  are  in  the  process  of 
planning  an  animal  study  (Task  4b)  for  the  evaluation  of  the  surgical  technique,  ease  of  use  and  potential  hurdles  in  the 
adoption  of  the  LAPUS  probe  in  robot-assisted  laparoscopic  prostatectomy.  We  are  currently  drafting  a  protocol  for  the 
IRB  approval  of  the  proposed  animal  study.  I  am  actively  working  with  (and  learning  from)  our  urology  surgeons  and 


residents  to  put  together  a  series  of  tasks  for  the  study.  We  intend  to  compare  the  performance  and  ease  of  use  of  our 
robotic  LAPUS  probe  with  a  standard  rigid  laparoscopic  ultrasound  probe  and  with  the  transrectal  TRUS  probe. 

Advances  have  also  been  made  in  improving  the  robustness  of  our  elastography  algorithm.  We  have  added  the 
capability  for  2D  and  3D  mosaics.  Our  work  was  submitted  for  publication  -  Appendix  5: 

Fleming,  L,  Fouroughi,  P.,  Boctor,  E.,  Hager,  G.,  "Ultrasound  Elastography  Mosaicing",  in  Proceedings  of 
Medical  Image  Computing  and  Computer  Assisted  Interventions  (MICCAI) 

With  regards  to  Task  1.  Education  and  Training  (Year  1-3),  I  am  constantly  learning  and  improving  as  a 
prostate  cancer  scientist.  I  have  regular  meetings  with  my  mentors.  Dr.  Allaf,  Dr.  Macura  and  Dr.  Boctor  which 
provide  me  with  urology  and  radiology  insights.  I  have  completed  relevant  coursework  (Surgical  Robotics, 
Computer  Integrated  Surgery  Seminar)  and  also  the  education  needed  to  prepare  and  propose  to  the  IRB  for 
human  and  animal  studies  (Human  subject  research.  Animal  safety.  Radiation  safety.  Animal  care  and  use. 
Research  ethics.  Privacy  issues.  Blood  borne  pathogens).  The  biggest  gains  were  made  however  discussing  the 
direction  and  means  of  accomplishing  our  study's  goals.  I  spent  valuable  time  with  the  Johns  Hopkins  Hospital 
Pathology  department,  where  I  have  witnessed  first  hand  both  the  macro  pathology  and  the  micro  pathology 
processing  of  prostate  specimens.  The  pathology  staff  and  doctors  provided  me  with  step  by  step  directions 
through  the  process  which  was  very  helpful  for  developing  a  study  in  which  ultrasound  imaging  would  not 
hinder  subsequent  pathological  processing.  In  preparing  for  the  future  animal  study  I  also  interacted  with 
surgeons  skilled  in  radical  prostatectomy.  These  discussions,  coupled  with  operating  room  observations  with 
Dr.  Allaf  and  Dr.  Su  are  the  foundation  of  my  prostate  cancer  education  and  training.  With  respect  to  my 
engineering  education  and  training,  I  have  completed  all  the  courses  recommended  by  my  mentors  but  I 
continue  to  learn  by  participating  in  departmental  and  surgical  robotics  specific  seminars,  in  which  I  am 
enrolled  every  semester.  In  2012,  I  attended  the  SPIE  Medical  Imaging  Conference  which  provided  me  with 
insight  into  the  frequent  collaborations  between  engineers  and  physicians. 

3.  KEY  RESEARCH  ACCOMPLISHMENTS 

•  Completion  of  study  on  ex-vivo  prostate  specimens  using  standard  ultrasound  probe  as  an  equivalent  to 
the  LAPUS  probe 

•  Analysis  of  study  data;  results  show  elastography  has  the  potential  to  detect  prostate  cancer  through 
direct  interrogation  techniques 

•  Phantom  study  using  a  modified  prostate  elastography  phantom;  comparison  of  LAPUS  and  TRUS; 
results  show  feasibility  in  lesion  detection  with  elastography  but  there  are  concerns  about  probe 
manipulation  due  to  its  size 

•  Planning  animal  study  to  better  evaluate  usability  and  performance  of  LAPUS  probe. 

4.  REPORTABLE  OUTCOMES 

1.  Fleming,  L,  Rivaz,  H.,  Boctor,  E.,  Hager,  G.  ‘"Robust  Dynamic  Programming  Method  for  Ultrasound 
Elastography',  Proceedings  of  SPIE  Medical  Imaging,  San  Diego,  CA,  February  2012  -  published  paper 

2.  Fleming,  L,  Rivaz,  H.,  Boctor,  E.,  Hager,  G.  “Robust  Dynamic  Programming  Method  for  Ultrasound 
Elastography" ,  Proceedings  of  SPIE  Medical  Imaging,  San  Diego,  CA,  February  2012  -  presented  poster. 

3.  Billings,  S.,  Nishikant,  D.,  Kang,  H.  J.,  Taylor,  R.,  Boctor,  E.,  "System  for  robot-assisted  real-time 
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5.  CONCLUSION 


Ex-vivo  prostate  specimens  study  was  completed  using  standard  ultrasound  probe  as  an  equivalent  to  the 
LAPUS  probe.  Data  was  analyzed  and  the  results  show  elastography  has  the  potential  to  detect  prostate  cancer 
through  direct  interrogation  techniques.  Scientific  findings  were  published  in  the  Medical  Science  Monitor 
Journal.  A  phantom  study  using  a  modified  prostate  elastography  phantom  was  completed.  LAPUS  and  TRUS 
probe  were  compared  and  the  results  show  feasibility  in  lesion  detection  with  elastography  but  there  are 
concerns  about  probe  manipulation  due  to  its  size.  An  animal  study  to  better  evaluate  usability  and  performance 
of  LAPUS  probe  is  planned  for  the  next  9  months.  Clinical,  prostate  cancer  and  engineering  education  and 
training  are  on  track. 
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Figure  3.  Chang  e-in- slope  detection  algorithm.  The  3  (three) 
consecutive  (a)  or  not  (b) 


positions  where  the  change  in  slope  is  exhibited  could  be 


4.  RESULTS  AND  DISCUSSION 

4.1  Deformation  Slope 

For  a  robust  AM2D  algorithm  one  single  successful  seed  RF-line  is  sufficient.  The  ehang e-in- slope  parameter 
was  designed  to  select  good  seed  lines  with  monotonously  increasing/decreasing  displacement  profile.  Over  all 
1458  computations  of  the  parameter  (486  lines  *  3  values),  the  sensivity  for  selecting  a  good  line  was  91.7%, 
while  the  specificity  was  48.6%  (  Table  2).  The  measure  performed  up  to  93.1%  sensitivity  when  tested  across 
just  one  w  value.  We  concluded  the  measure  was  promising  but  not  sufficient  on  its  own. 


Table  2.  Chang  e-in- Slope  (TP  =  true  positive,  FP  =  false  positive,  TN  =  true  negative,  FN  =  false  negative) 

Prediction  outcome 


actual 

value 


p 

u 

TP  =  835 

FN  =  238 

FP  =  76 

TN  =  252 

P 

N 

total 

P' 


N' 


4.2  Displacement  Stability 

486  scores  were  computed,  one  for  each  potential  seed  RF-line.  The  scores  ranged  from  0  to  0.2649.  The  average 
score  for  the  good  lines  was  0.0058  (stdev  =  0.0186)  and  the  average  score  for  the  faulty  lines  was  0.0444  (stdev 
=  0.0586).  A  one-side  Student  t-test  showed  a  p- value  of  3.73909e  —  17  (  Table  3). 

To  increase  the  significance  of  the  prediction  value,  we  also  computed  a  combined  score  for  the  two  detection 
algorithms.  The  averaged  Change-in- Slope  score  over  the  3  (three)  values  for  w  was  either  0,  0.33,  0.66,  or 
1,  depending  on  how  many  of  the  three  instances  were  deemed  positive  by  the  test.  This  score  was  added  to 
the  Displaeement  Stability  score  for  a  combined  overall  score.  This  overall  score  ranged  from  0  to  1.1588.  The 
average  score  for  the  good  lines  was  0.0795  (stdev  =  0.2422)  and  the  average  score  for  the  faulty  lines  was  0.4939 
(stdev  =  0.4444),  for  a  p-value  of  1.75837e  —  27  (  Table  3). 


Table  3.  Robustness  score:  Displacement  Stability  vs.  Combined  score  for  Displacement  Stability  +  Change- in- Slope 


Displ.  Stability 

Displ.  Stability  +  Ghange-in-Slope 

Good  Lines 

Eaulty  Lines 

Good  Lines 

Eaulty  Lines 

Min 

0 

0 

0 

0 

Max 

0.1002 

0.2649 

1 

1.1588 

Avg 

0.0058 

0.0444 

0.0795 

0.4939 

StDev 

0.0186 

0.0586 

0.2422 

0.4444 

p- value 

3.73909E-17 

1.75837E-27 

Following  the  results  of  this  analysis,  a  random  search  algorithm  was  implemented  for  the  selection  of  a 
robust,  stable  seed  RF-line  as  follows: 

1.  DP  integer  displacement  is  calculated  for  5  random  RF-lines,  each  at  5  random  w  values 

2.  A  combined  Chang  e-in- Slope  average  plus  Displaeement  Stability  average  score  is  computed 

3.  The  most  robust,  stable  line  is  chosen  as  the  line  with  the  smallest  combined  score,  which  also  does  not 
have  any  positive  Chang  e-in- Slope  score 

4.  The  chosen  seed  line’s  displacement  values  are  propagated  using  the  AM2D  method 

Given  the  current  parallel  computational  resources,  the  addition  of  this  selection  test  does  not  add  a  significant 
amount  of  time  to  the  overall  running  time.  DP  takes  the  same  time  as  before  but  it’s  now  computed  25  times, 
and  the  computation  of  each  score  takes  on  the  order  of  a  couple  of  milliseconds.  On  100  random  runs  of  our 
testing  algorithm,  we  only  encountered  1  (one)  situation  where  a  faulty  line  was  selected.  The  reason  for  the 
selection  was  that  all  5  of  the  random  line  tested  were  faulty.  This  prompted  us  to  introduce  the  additional 
condition  that  the  chosen  line  should  not  have  any  positive  Chang  e-in- Slope  score.  Following  this  modification, 
no  faulty  situation  has  been  encountered  so  far.  We  will  continue  to  test  our  algorithm  on  the  presented  data 
set,  as  well  as  on  new  ex-vivo  and  in-vivo  tissue  data. 

5.  CONCLUSION 

We  proposed  and  successfully  implemented  an  algorithm  for  the  selection  of  a  robust,  stable  RF-line  to  be  used  as 
seed  for  the  DP  displacement  estimation  and  later  propagated  using  the  AM2D  algorithm  for  elastography.  The 
benefit  of  this  algorithm  is  significant  as  it  has  the  potential  to  improve  the  robustness  of  ultrasound  elastography 
in  in-vivo  tissue  which  can  be  highly  decorrelated.  We  are  in  the  process  of  evaluating  this  hypothesis.  The 
selection  of  robust  seed  RF-lines  becomes  even  more  important  as  we  move  towards  real-time  3D  ultrasound 
elastography. 
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ABSTRACT 

Surgical  robots  provide  many  advantages  for  surgery,  including  minimal  invasiveness,  precise  motion,  high 
dexterity,  and  crisp  stereovision.  One  limitation  of  current  robotic  procedures,  compared  to  open  surgery,  is  the  loss 
of  haptic  information  for  such  purposes  as  palpation,  which  can  be  very  important  in  minimally  invasive  tumor 
resection.  Numerous  studies  have  reported  the  use  of  real-time  ultrasound  elastography,  in  conjunction  with 
conventional  B-mode  ultrasound,  to  differentiate  malignant  from  benign  lesions.  Several  groups  (including  our  own) 
have  reported  integration  of  ultrasound  with  the  daVinci  robot,  and  ultrasound  elastography  is  a  very  promising 
image  guidance  method  for  robot-assisted  procedures  that  will  further  enable  the  role  of  robots  in  interventions 
where  precise  knowledge  of  sub-surface  anatomical  features  is  crucial.  In  this  paper,  we  present  a  novel  robot- 
assisted  real-time  ultrasound  elastography  system  for  minimally  invasive  robot-assisted  interventions.  Our  system 
combines  a  daVinci  surgical  robot  with  an  experimental  software  interface,  a  robotically  articulated  laparoscopic 
ultrasound  probe,  and  our  GPU-based  elastography  system.  Elastography  and  B-mode  ultrasound  images  are 
displayed  as  picture-in-picture  overlays  in  the  daVinci  console.  Our  system  minimizes  dependence  on  human 
performance  factors  by  incorporating  computer-assisted  motion  control  that  automatically  generates  the  tissue 
palpation  required  for  elastography  imaging,  while  leaving  high-level  control  in  the  hands  of  the  user.  In  addition  to 
ensuring  consistent  strain  imaging,  the  elastography  assistance  mode  avoids  the  cognitive  burden  of  tedious  manual 
palpation.  Preliminary  tests  of  the  system  with  an  elasticity  phantom  demonstrate  the  ability  to  differentiate 
simulated  lesions  of  varied  stiffness  and  clearly  delineate  lesion  boundaries. 

DESCRIPTION  OF  PurPOSE  /  NEW  WORK  PRESENTED 

Surgical  robots  provide  many  advantages  for  surgery,  including  minimal  invasiveness,  precise  motion,  high 
dexterity,  and  crisp  stereovision.  One  limitation  of  current  robotic  procedures,  compared  to  open  surgery,  is  the  loss 
of  haptic  information  for  such  purposes  as  palpation,  which  can  be  very  important  in  minimally  invasive  tumor 
resection.  Numerous  studies  have  reported  the  use  of  real-time  ultrasound  elastography,  in  conjunction  with 
conventional  B-mode  ultrasound,  to  differentiate  malignant  from  benign  lesions  in  prostate,  breast,  pancreas,  lymph 
nodes,  and  thyroid. Ultrasound  elastography  is  thus  a  very  promising  image  guidance  method  for  robot- 
assisted  procedures  that  will  further  enable  the  role  of  robots  in  interventions  where  precise  knowledge  of  hidden 
anatomical  features  is  crucial.  Several  groups  (including  our  own)  have  reported  integration  of  ultrasound  with  the 
daVinci  robot.^^’^’^^  In  this  paper,  we  present  a  novel  robot-assisted  real-time  ultrasound  elastography  system  for 
minimally  invasive  robot-assisted  interventions. 


METHODS 

In  general,  cancerous  tissue  has  higher  cell  density  than  surrounding  healthy  tissue,  which  leads  to  elevated  tumor 
stiffness  that  can  be  visualized  using  elastography  techniques.  As  first  described  by  Ophir  et  al.,^^^  the  principle  of 
ultrasound  elastography  is  to  estimate  tissue  stiffness  from  measurement  of  tissue  strain  induced  by  an  applied  force. 
This  is  accomplished  by  measuring  relative  tissue  displacements  between  ultrasound  image  pairs  under  different 
states  of  induced  compression.  Because  ultrasound  elastography  algorithms  assume  an  axial  compression,  strain 
image  quality  may  degrade  when  non-axial  motion  or  probe  rotation  occurs  during  compression.  Axial  compression 
is  typically  on  the  order  of  only  a  millimeter  or  two,  and  even  small  amounts  of  unwanted  motion  may  affect  image 
quality.  Due  to  the  variability  in  manual  compression,  image  quality  for  free-hand  elastography  is  highly  dependent 
on  practitioner  skill  and  experience. 

The  quality  of  elastography  imaging  as  a  function  of  human  performance  is  minimized  by  our  robot-assisted 
elastography  system  through  computer-integrated  motion  control  for  tissue  compression,  whereby  tissue  is 
autonomously  compressed  along  the  direction  axial  to  the  ultrasound  probe.  The  system  computer  provides  assistive 


control  of  robot  motion  by  generating  a  sinusoidal  palpation  motion  that  is  overlaid  onto  motion  commands  from  the 
master  manipulators  (Error!  Reference  source  not  found.).  By  this  method,  the  surgeon  retains  overall  control  of 
the  ultrasound  probe  position  and  orientation,  while  the  computer  controls  the  finer  points  of  tissue  compression. 
Because  the  computer  has  accurate  knowledge  of  the  ultrasound  probe  position  and  is  not  subject  to  motion  errors 
like  a  human  operator,  consistent  tissue  compression  in  the  precise  axial  direction  is  ensured. 


The  elastography  assistance  mode  improves  the  precision  and  consistency  of  tissue  compression  beyond  what  can  be 
achieved  by  manually  controlled  teleoperation  while  also  reducing  the  cognitive  burden  for  the  user.  Continual 
palpation  of  tissue  under  manual  control  is  a  tedious  task  imposing  a  large  cognitive  burden  and  demand  of  focus. 

By  relieving  this  burden  through  computer  assistance,  the  user  is  able  to  focus  on  more  important  tasks  such 
interpreting  real-time  imaging  information  and  conducting  surgery. 
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Figure  1.  Block  diagram  of  our  robot-assisted  system  for  real-time  ultrasound  elastography. 


Error!  Reference  source  not  found,  shows  a  block  diagram  of  our  complete  system  for  robot-assisted  ultrasound 
elastography.  At  the  heart  of  the  system  is  the  daVinci  S  surgical  robot  (Intuitive  Surgical  Inc.,  Sunnyvale,  CA). 
Computer  integrated  control  of  robot  motion  is  facilitated  by  an  experimental  “ReadAVrite”  Research  Application 
Programming  Interface  (API)  provided  by  Intuitive  Surgical  Inc.,  which  enables  robot  motion  to  be  controlled  from 
computer  in  addition  to  control  inputs  from  the  master  console,  as  discussed  below.  The  daVinci  robot  manipulates  a 
prototype  version  of  a  robotically  articulated  laparoscopic  ultrasound  probe  (Figure  2a),  also  developed  by  Intuitive 
Surgical  Inc.,  which  was  built  into  the  form  factor  of  a  standard  daVinci  tool.  The  ultrasound  probe  has  a  linear  array 
transducer  (Gore,  Newark  DE)  with  128  elements  that  measures  50mm  in  length  with  a  probe  diameter  of 
approximately  9mm.  The  ultrasound  probe  is  driven  by  a  Sonix  RP  ultrasound  system  (Ultrasonix  Medical  Corp., 
Richmond  BC  Canada),  which  provides  an  Ultrasound  Research  Interface  granting  access  to  pre-beam  formed  RF 
data  from  the  ultrasound  probe.  Access  to  this  RF  data  is  critical  to  reaching  optimal  performance  from  elastography 
algorithms.  The  RF  data  is  processed  by  a  high-performance  external  NVIDIA  Tesla  series  GPU,  which  connects 
locally  to  the  Sonix  RP  system.  The  GPU  provides  sufficient  parallel  computing  power  to  generate  strain  images 
from  RF  data  in  real  time  using  an  elastography  algorithm  based  on  normalized  cross-correlation. The 
elastography  images  from  the  GPU  are  streamed  from  the  Sonix  RP  system  to  a  network  port  on  the  system’ s  central 
workstation.  The  workstation  also  receives  a  parallel  stream  of  conventional  B-mode  ultrasound  images  from  the 
Sonix  RP  machine  directly.  The  workstation  sends  both  image  streams  to  picture-in-picture  overlays  shown  in  the 
stereo  display  of  the  daVinci  console.  The  picture  overlays  enable  the  surgeon  to  observe  the  ultrasound  and 
elastography  image  feeds  in  real-time  without  releasing  control  of  the  robot  arms  or  diverting  attention  away  from 
the  task  at  hand. 


In  collaboration  with  Intuitive  Surgical,  the  Engineering  Research  Center  for  Computer-Integrated  Surgical  Systems 
and  Technology  (CISST  ERC)  at  Johns  Hopkins  University  has  developed  an  open-source  software  framework  for 


medical  robotics  and  computer  assisted  surgical  systems  research,  which  we  call  Surgical  Assistant  Workstation 
(SAW)  This  open-source  framework  is  an  extension  of  the  CISST  software  libraries  developed  at  Johns 

Hopkins  to  enable  rapid  application  development  by  providing  capabilities  including  basic  mathematics  and 
numerical  routines,  thread  execution  management,  inter-process  communication,  construction  and  control  of  video 
pipelines,  and  many  other  things. Although  the  software  components  providing  its  basic  capabilities  are  all 
open-source,  SAW  is  designed  to  be  compatible  with  proprietary  modules  through  module  wrappers  using  well- 
defined  interface  protocols.  In  particular,  we  have  developed  SAW  wrappers  that  provide  the  ability  to  interface 
with  the  read-only  and  read-write  research  interfaces  of  the  daVinci  robot.  The  capabilities  of  the  Read-Only 
daVinci  Research  Interface  include  the  ability  to  query  the  state  of  the  master  and  slave  robot  arms  and  of  user 
console  events. The  ReadAVrite  daVinci  Research  Interface  extends  these  features  with  the  capability  to  use 
software  to  command  motions  of  the  master  and  slave  robot  arms  and  to  trigger  user  events.  One  such  feature  allows 
us  to  superimpose  an  externally  computed  motion  onto  motion  inputs  from  the  master  manipulators.  We  use  this 
capability  in  our  system  to  create  computer  generated  motion  overlays  for  tissue  palpation.  Another  function  of 
SAW  allows  us  to  use  a  master  arm  controller  effectively  as  a  3D  mouse.  We  call  this  masters-as-mice  mode.  We 
use  this  mode  in  our  system  to  build  an  interactive  environment  for  the  daVinci  operator  to  control  and  interact  with 
video  overlays. 

The  SAW  software  package  is  implemented  on  the  central  workstation  of  our  system,  which  centralizes  processing 
for  user  interaction  with  image  overlays,  acquisition  of  real-time  image  streams,  and  implementation  of  the  control 
loop  generating  assistive  motion  for  tissue  palpation.  A  command  terminal  on  the  central  workstation  allows  the  user 
to  set  the  amplitude  and  frequency  of  tissue  palpation.  These  settings  may  be  updated  in  real-time.  The  terminal  also 
allows  palpation  to  be  activated/deactivated  at  will.  The  user  interacts  with  the  image  overlays  from  the  daVinci 
console  using  the  SAW  masters-as-mice  mode,  which,  for  the  daVinci  system,  is  activated  by  engaging  the  clutch 
foot  pedal  followed  by  a  double-pinch  of  both  master  manipulators  in  unison.  The  masters-as-mice  mode  activates 
an  interactive  menu  environment  in  which  the  daVinci  master  controllers  manipulate  virtual  cursors  in  the  daVinci 
console’s  stereo  display  (Figure  2a).  Menu  selections  are  made  by  moving  a  cursor  to  a  menu  icon  and  pinching  the 
corresponding  master  controller.  The  elastography  and  B-mode  ultrasound  image  overlays  are  activated  by  selecting 
the  appropriate  menu  icon  with  a  virtual  cursor  (pinching  master  controller  selects).  The  image  overlays  are  resized 
and  repositioned  in  the  daVinci  display  by  dragging  them  with  a  cursor.  Releasing  the  clutch  pedal  returns  the 
master  manipulators  to  control  of  the  slave  arms  and  maintains  the  image  overlays  in  the  user’s  field  of  view. 

Results 

Preliminary  tests  of  the  system  have  been  conducted  with  a  CIRS  Model  049  Elasticity  QA  Phantom,  which  has 
simulated  lesions  of  different  calibrated  stiffness.  Figure  2b  presents  a  snap-shot  of  the  daVinci  display  taken  during 
phantom  testing  with  image  overlays  displaying  the  real-time  imaging  results.  The  elastography  image  in  this  figure 
shows  clear  difference  in  contrast  between  a  soft  and  hard  lesion,  with  the  hard  lesion  appearing  darker  in  the  image. 
This  distinction  cannot  be  made  from  the  B-mode  ultrasound  image  in  this  figure.  The  elastography  image  also 
establishes  clear  delineation  of  lesion  boundaries,  which  would  not  be  discernible  from  B-mode  ultrasound  in  the 
case  of  isoechoic  lesions.  These  images  were  recorded  with  tissue  palpation  set  to  1mm  amplitude  and  IHz 
frequency. 


CONCLUSION 

We  have  successfully  implemented  a  robot-assisted  system  for  minimally  invasive,  real-time  ultrasound 
elastography.  Our  system  provides  an  improvement  over  manual  elastography  techniques  by  unifying  motion 
commands  from  a  user  with  the  precision  and  accuracy  of  computer-assisted  motion  control  to  ensure  consistent  and 
precise  tissue  strain.  Our  approach  effectively  reduces  the  cognitive  load  of  the  human  operator  while  maintaining  a 
user’s  control  of  the  procedure.  Preliminary  tests  using  an  elasticity  phantom  demonstrate  the  system’s  capability  to 
generate  strain  images  in  real-time  that  can  be  used  to  delineate  simulated  lesion  boundaries  and  differentiate  lesions 
of  varying  stiffness. 
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Figure  2.  a)  Interactive  menu  environment  for  displaying  image  overlays  in  the  daVinci  console  display,  showing  an 
active  menu  with  two  virtual  mice  corresponding  to  the  left  and  right  master  manipulators  and  two  picture-in-picture 
image  overlays  (picture  taken  of  a  patient  side  monitor),  b)  View  of  the  daVinci  console  display  during  a  test  with  an 
elasticity  phantom;  the  elastography  image  overlay  differentiates  lesions  of  different  stiffness. 
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Summary 

Background: 

During  laparoscopic  or  robotic  assisted  laparoscopic  prostatectomy,  the  surgeon  lacks  tactile  feed¬ 
back  which  can  help  him  tailor  the  size  of  the  excision.  Ultrasound  elastography  (USE)  is  an 
emerging  imaging  technology  which  maps  the  stiffness  of  tissue.  In  the  paper  we  are  evaluating 
USE  as  a  palpation  equivalent  tool  for  intraoperative  image  guided  robotic  assisted  laparoscopic 
prostatectomy. 

Material/Methods: 

Two  studies  were  performed:  1)  A  laparoscopic  ultrasound  probe  was  used  in  a  comparative  study 
of  manual  palpation  versus  USE  in  detecting  tumor  surrogates  in  synthetic  and  ex-vivo  tissue  phan¬ 
toms;  N=25  participants  (students)  were  asked  to  provide  the  presence,  size  and  depth  of  these 
simulated  lesions,  and  2)  A  standard  ultrasound  probe  was  used  for  the  evaluation  of  USE  on  ex- 
vivo  human  prostate  specimens  (N=10  lesions  in  N=6  specimens)  to  differentiate  hard  versus  soft 
lesions  with  pathology  correlation.  Results  were  validated  by  pathology  findings,  and  also  by  in-vivo 
and  ex-vivo  MR  imaging  correlation. 

Results: 

In  the  comparative  study,  USE  displayed  higher  accuracy  and  specificity  in  tumor  detection  (sen- 
sitivity=84%,  specificity=74%).  Tumor  diameters  and  depths  were  better  estimated  using  USE  ver¬ 
sus  with  manual  palpation.  USE  also  proved  consistent  in  identification  of  lesions  in  ex-vivo  pros¬ 
tate  specimens;  hard  and  soft,  malignant  and  benign,  central  and  peripheral. 

Conclusions: 

USE  is  a  strong  candidate  for  assisting  surgeons  by  providing  palpation  equivalent  evaluation  of 
the  tumor  location,  boundaries  and  extra-capsular  extension.  The  results  encourage  us  to  pursue 
further  testing  in  the  robotic  laparoscopic  environment. 
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Background 


Prostate  cancer  is  the  second  leading  cause  of  cancer  death 
and  the  most  common  cancer  detected  in  men  in  the 
United  States.  An  estimated  217,730  new  cases  of  prostate 
cancer  were  diagnosed  in  the  United  States,  and  approx¬ 
imately  32,050  men  died  of  prostate  cancer  during  2010 

[1] .  Radical  Prostatectomy  (RP)  aims  for  complete  cancer 
resection  and  has  been  shown  to  improve  cancer  survival 

[2] .  Robotic-assisted  laparoscopic  prostatectomy  (RALP) 
has  recently  emerged  as  an  alternative  to  open  and  laparo¬ 
scopic  procedures.  The  daVinci  Surgical  System  (Intuitive 
Surgical,  Sunnyvale,  (TA)  provides  3-D  visualization,  high¬ 
er  magnification,  hand  tremor  elimination  and  refined 
dexterity  by  incorporating  wristed  instrumentation.  From 
250  robotic  cases  in  the  beginning  (2001),  the  number  has 
reached  73,000  in  2009  (86%  of  the  85,000  American  men 
who  had  prostate  cancer  surgery)  [3,4]. 

Initial  experiences  with  the  daVinci  surgical  system  have 
been  positive:  short  learning  curve,  limited  blood  loss,  less 
post-operative  pain,  favorable  complication  rates,  and  short 
hospital  stay  [3-10].  Despite  fewer  perioperative  compli¬ 
cations  and  shorter  hospital  stay,  a  recent  paper  found  pa¬ 
tients  were  three  times  more  likely  to  require  salvage  therapy 
[11] .  One  theoretical  disadvantage  with  regards  to  robotic 
surgery  is  the  lack  of  tactile  feedback.  In  open  RPs,  the  sur¬ 
geon  uses  his  fingers  to  feel  the  periphery  of  the  prostate 
gland  [12].  Without  tactile  feedback,  a  robotic  surgeon  is 
unable  to  appreciate  differences  in  tissue  texture  or  firm¬ 
ness  and  therefore  may  not  be  able  to  tailor  precisely  the 
extent  of  tissue  excision  around  the  prostate  gland  in  ef¬ 
forts  to  eradicate  all  cancerous  tissue.  Inadvertently  leaving 
residual  cancer  cells  behind,  called  a  positive  surgical  mar¬ 
gin  (PSM) ,  is  highly  associated  with  cancer  recurrence.  PSM 
rates  were  initially  higher  in  RALP  than  in  the  open  proce¬ 
dure,  but  they  have  been  shown  to  decrease  with  surgeon’s 
experience  and  improved  technique  [9,11]. 

As  manual  palpation  helps  guide  the  surgeon  in  the  open 
procedure,  an  equivalent  real-time  guiding  tool  is  needed 
for  robotic  prostatectomy.  Imaging  modalities  like  MRJ  or 
CT  are  not  feasible  intraoperatively,  nor  do  they  possess  the 
sensitivity  or  specificity  for  accurate  detection  and  local¬ 
ization  of  prostate  cancer.  Transrectal  ultrasound  (TRUS) 
is  routinely  used  in  diagnosis,  in  conjunction  with  digital 
rectal  examination  (DRE)  and  biopsies  [13].  One  center 
used  TRUS  for  real-time  monitoring  and  guidance  during 
Laparoscopic  RP  and  reported  technical  feasibility  and  en¬ 
hanced  precision  by  decreased  PSM  rates  [14,15].  TRUS 
was  capable  of  imaging  a  substantial  percent  of  nonpal- 
pable  prostate  cancers.  The  authors  recognized  however, 
the  limitations  of  TRUS  guidance;  it  requires  considerable 
prior  expertise  and  tends  to  identify  primarily  hypoecho- 
ic  lesions,  which  were  just  47%  of  the  cancer  nodules  stud¬ 
ied  [15].  Today’s  prostate  cancer  patients  are  more  likely 
to  present  with  echogenic  or  isoechoic  lesions  because  ag¬ 
gressive  screening  techniques  lead  to  a  shift  toward  small¬ 
er,  early-stage  cancers  [16,17];  classic  B-mode  gray-scale  ul¬ 
trasound  alone  cannot  identify  these  lesions. 

Ultrasound  (US)  Elastography  (USE)  is  emerging  as  a  valu¬ 
able  tool  in  the  field  of  imaging.  Elastography  is  a  qualitative 
technique  based  on  the  principle  that  tissue  compression 


produces  strain  (displacement)  within  that  tissue;  strain  is 
smaller  in  harder,  stiffer  tissue  than  in  softer,  more  compli¬ 
ant  tissue  [18] .  Analyzing  the  ultrasound  raw  radio  frequen¬ 
cy  signal  results  in  a  strain  map,  commonly  called  elastogram, 
where  harder  tissue  is  darker  than  surrounding  soft  tissue. 
Cancers  tend  to  present  as  hard  lesions  due  to  increased  cel- 
lularity  [18] .  Echogenicity  and  stiffness  of  tissue  are  gener¬ 
ally  uncorrelated;  USE  can  identify  hypoechoic  lesions,  but 
also  echogenic  or  isoechoic  cancers  that  classic  gray-scale  ul¬ 
trasonography  cannot.  Elastography  through  the  transrec¬ 
tal  approach  has  already  been  proven  feasible  in  guiding  bi¬ 
opsies  of  the  prostate  [19-22].  Integrating  USE  technology 
with  a  laparoscopic  ultrasound  probe  will  give  robotic  and 
laparoscopic  surgeons  an  important  image-guidance  tool, 
which  until  this  point  does  not  exist  [23-25] . 

This  paper  describes  two  experiments  and  results  of  an  on¬ 
going  study  evaluating  the  diagnostic  accuracy  and  efficacy 
of  using  USE  to  identify  the  cancerous  nodules  in  the  pros¬ 
tate  gland.  The  aim  of  the  first  study  was  to  compare  the 
ability  of  subjects  to  detect  hard  tissue  (tumor  surrogates) 
in  synthetic  and  ex-vivo  phantoms.  We  attempted  to  mimic 
an  OR  setting  of  open  vs.  robotic  procedures,  by  asking  the 
subjects  to  identify  properties  of  the  tissue  using  manual  pal¬ 
pation  in  one  arm,  versus  using  ultrasound  elastograms  in 
the  other  arm.  The  elastograms  were  obtained  with  a  lapa¬ 
roscopic  ultrasound  probe.  In  the  second  study,  human  ex- 
vivo  prostatectomy  specimens  where  used  to  assess  the  ac¬ 
curacy  of  USE  in  the  identification  and  characterization  of 
hard  cancerous  nodules.  We  compared  the  elastogram  re¬ 
sults  with  histopathology  maps  (the  gold  standard)  and  also 
to  pre-  and  post-operative  MR  scans  of  the  prostate  gland 
in  order  to  assess  and  co-localize  anatomically  USE  with  the 
reference  histopathology  and  MR  scans. 

Material  AND  Methods 


Comparative  study  for  USE  vs.  manual  palpation  in  tumor 
detection 

Institutional  Review  Board  approval  was  obtained  for  the 
comparative  study.  We  recruited  N=25  local  students  to  ass¬ 
es  human  ability  to  feel  hard  lesions  through  palpation,  ver¬ 
sus  elastography’s  ability  to  distinguish  the  same  lesions.  Our 
decision  to  use  local  students  instead  of  seasoned  surgeons 
stemmed  from  the  rationale  that  all  humans  are  born  with 
the  sense  of  touch  and  thus  have  the  innate  sensory  ability  to 
palpate;  we  were  also  able  to  recruit  more  subjects  in  order 
to  assess  inter-observer  variability.  Participants  were  asked  to 
identify  lesions  present  in  both  synthetic  and  ex-vivo  phan¬ 
toms.  The  subjects  evaluated  the  phantoms  using  manual 
palpation  and  ultrasound  based  elastograms.  The  hypothe¬ 
sis  of  the  study  was  that  subjects  could  identify  lesions  easi¬ 
er  on  the  elastograms  versus  using  manual  palpation.  Seven 
synthetic  and  four  ex-vivo  tissue  phantoms  were  created.  The 
phantoms  mimicked  the  mechanical  properties  of  prostate 
tissue  and  the  acoustic  scattering  properties  of  human  tis¬ 
sue.  Synthetic  phantoms  exhibited  deeper  spherical  hard  le¬ 
sions,  consistent  with  deeper  prostatic  cancerous  nodules, 
while  Ex-vivo  phantoms  had  superficial,  free-form  ablated  le¬ 
sions,  more  consistent  with  extra-capsular  cancer  extension. 

Synthetic  phantoms  (3x2x2  inches)  were  made  from  Liquid 
Plastic  (M-F  Manufacturing  Co.,  Inc.,  Hal  tom  City,  TX)  and 
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Figure  1.  Synthetic  phantoms:  (A)  lesions  are 

visible  from  the  side  (pink)  and  the  top 
is  opaque  (dark  blue);  (B,C)  inside  the 
grid  calibration  container;  (D)  X-ray  ofex- 
vivo  chicken  phantom.  Ablation  probe, 
tines  and  the  grid  calibration  container 
are  visible. 
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35  Figure  2.  Laparoscopic  ultrasound  probe;  close-up  view  of  the  probe's 
head  (insert).  Prototype  courtesy  of  Intuitive  Surgical. 


glass  micro-beads.  The  micro-beads  were  used  as  a  scattering 
40  material.  They  were  added  to  the  plastic  mix  in  an  1  %  concen¬ 
tration  to  mimic  the  acoustic  scattering  properties  of  human 
tissue;  both  the  lesions  and  the  rest  of  the  phantom  appeared 
isoechoic  under  B-mode  ultrasound.  Lesions  were  created  by 
varying  the  mixing  ratios  of  liquid  plastic  types;  the  ratio  be- 
45  tween  4116S  Plastic  Softener  or  7116  Plastic  Hardener  and 
8116  Super-Soft  Plastic  determined  the  final  density  and  the 
elastic  modulus  of  the  lesions  and  the  background  [26] .  Each 
phantom  contained  0-3  harder  spherical  lesions  (1-2  cm  di¬ 
ameter)  colored  pink  for  ground  truth  identification  (Figure 
50  lA) .  The  exposed  top  surface  was  colored  opaque  blue,  to  pre¬ 
vent  the  subjects  from  visually  identifying  the  lesions  (Figure 
lA) .  The  synthetic  phantoms  were  sliced  and  sectioned  at  study 
end,  following  axial  planes  parallel  with  the  ultrasound  scan¬ 
ning  plane.  The  depth  of  each  lesion  was  measured  as  the 
55  distance  between  the  surface  of  the  phantom  and  the  top  of 
the  lesion  itself.  The  final  depth  of  lesions  for  these  7  (sev¬ 
en)  phantoms  was  measured  to  be  between  7  and  25  mm. 

Ex-vivo  phantoms  were  constructed  from  raw  chicken  breast 
60  tissue.  Hard  lesions  of  various  diameters  were  created  us¬ 
ing  radio  frequency  (RF)  ablation,  at  an  average  tempera¬ 
ture  of  95  degrees  Fahrenheit  for  20  minutes.  This  formed 
63  a  hard  spherical  lesion  at  a  depth  of  1-6  mm  below  the  sur¬ 
face,  which  allowed  for  possible  palpation  but  not  the  visual 


localization  of  lesions.  Before  ablation,  each  tissue  was  placed 
in  a  small  plastic  container  and  surrounded  by  150  Bloom 
porcine  gelatin  (Bloom  represents  an  unit  of  measure  for  ri-  25 
gidity  of  gelatin) .  X-ray  axial  scans  (projection  plane  parallel 
with  the  ultrasound  scanning  plane)  were  used  to  localize  and 
measure  the  lesions  (Figure  ID).  The  tissue  phantoms  were 
sliced  on  the  same  axial  plane  at  study  end  to  determine  the 
depth  and  extent  of  the  ablated  areas.  The  depth  of  each  le-  30 
sion  was  measured  as  the  distance  between  the  surface  of  the 
phantom  and  the  top  of  the  lesion  itself.  For  ex-vivo  lesions, 
the  final  depth  of  lesions  was  measured  to  be  less  than  7  mm. 

Hardware  and  software  specification  35 

For  the  comparative  study,  a  laparoscopic  ultrasound  probe 
was  used,  fitted  with  a  transducer  (Gore  Tetrad,  Englewood, 

CO)  with  a  center  frequency  of  7.5  MHz,  and  128  elements 
(Figure  2)  [23-25].  Ultrasound  raw  radio-frequency  data  40 
was  acquired  using  an  Ultrasonix  US  scanner  (Ultrasonix 
Medical  Corporation,  Richmond,  BC,  Canada) .  Due  to  the 
relative  inexperience  of  our  subjects,  it  was  not  possible  to 
have  the  subjects  perform  real-time  elastography.  Thus,  to 
maintain  consistent  image  quality  and  to  minimize  user  de-  45 
pendence,  elastography  images  were  obtained  in  a  standard¬ 
ized  manner  by  one  of  our  researchers,  prior  to  the  evalua¬ 
tion.  Elastograms  were  generated  using  the  corresponding 
radio  frequency  data  and  our  dynamic  programming  (DP) 
elastography  algorithm  [27,28].  50 

During  the  study,  each  subject  reviewed  3-4  phantoms,  each 
placed  in  a  self-designed  calibration  container,  which  con¬ 
sisted  of  a  5-by-5  grid,  0.5  inches  apart,  labeled  with  num¬ 
bers  and  letters  along  the  two  axis  (Figure  IB,  C).  Subjects  55 
were  asked  to  identify  by  manual  palpation  the  location 
based  on  the  provided  grid  (i.e.  B4  or  A3),  and  also  the 
diameter  and  depth  of  each  lesion  using  0.5  inches  as  the 
unit  of  reference.  For  the  USE  arm  of  the  study,  the  sub¬ 
jects  first  underwent  an  USE  training  session,  where  they  60 
were  explained  the  concept  and  shown  sample  elastograms. 
They  were  then  presented  with  3-4  elastograms  of  the  phan¬ 
toms  and  they  were  asked  to  provide  the  presence,  size  and  63 
depth  of  lesions  given  the  scale  of  the  images.  The  order  in 
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Comparison  of  root  mean  squared  error  of  diameter  estimation 
Ultrasound  elastography  vs.  manual  palpation 


t 


B 


^  10- 
QJ 

E 


Comparison  of  root  mean  squared  error  of  estimation  of  lesion  depth 
Ultrasound  elastography  vs.  manual  palpation 


Manual  palpation 


Ultrasound  elastography 


Manual  palpation 


Ultrasound  elastography 


Figure  3.  Synthetic  phantom  study  results:  Box-and-whisker  plots  for  lesion  diameter  and  depth  from  surface  (A,B),  and  lesion  detection  rate 
according  to  depth  (C). 


which  the  subjects  completed  the  USE  and  manual  palpa¬ 
tion  tasks  was  randomized. 

Accuracy  was  determined  descriptively  using  box  and  whis¬ 
kers  plots  (Figure  3A,B),  sensitivity  and  specihcity  calcula¬ 
tions,  and  root  mean  squared  error  of  estimation  (RMSE)  ob¬ 
tained  from  subtracting  the  estimated  value  of  the  measured 
parameter  (diameter,  depth)  from  the  ground  truth  value 
determined  from  direct  measurement.  STATA  9  (StataCorp 
LP,  College  Station,  TX)  was  used  to  perform  the  statisti¬ 
cal  analysis,  which  consisted  of  Student’s  t-test  for  compar¬ 
ison  between  the  means  of  the  RMSE  of  both  diameter  and 
depth  as  estimated  via  manual  palpation  versus  USE.  The 
p-values  reported  were  generated  by  t-test  calculations  as¬ 
suming  unequal  variances  for  a  two-tailed  test  where  p=0.05. 

Ex-vivo  human  prostate  study  for  tumor  detection 

Prostate  cancer  patients,  candidates  for  prostatectomy,  were 
prospectively  enrolled  in  our  study,  following  an  informed 
consent  approved  by  the  Institutional  Review  Board.  The  ob¬ 
jective  of  the  study  was  to  evaluate  the  efficacy  of  using  elas¬ 
tography  to  identify  and  precisely  localize  hard  nodules  such 
as  seen  with  prostate  cancer  just  beneath  the  surface  of  the 
prostate  gland  in  the  peripheral  zone.  In  this  area,  cancer¬ 
ous  lesions  are  at  most  risk  of  invasion  beyond  the  confines 
of  the  prostate  gland  and  also  more  likely  to  be  cut  across  by 
a  well  meaning  surgeon.  We  recruited  patients  who  under¬ 
went  both  open  and  assisted  prostatectomies  given  that  the 
process  of  removing  the  gland  was  not  a  focus  of  our  study. 
Patients  underwent  multiple  radiological  procedures.  1)  Pre¬ 
operative  3  Tesla  MRI  of  the  pelvis  was  performed  right  be¬ 
fore  the  surgery  procedure.  2)  Post-operative  ultra  high-reso¬ 
lution  MRI  at  9.4  Tesla  was  performed  on  the  excised  prostate 
specimen  to  correlate  the  results  to  in-vivo  pre-operative  im¬ 
aging.  3)  USE  was  then  performed  on  the  prostate  specimen 
by  an  experienced  radiologist  blinded  to  the  surgeon’s  hnd- 
ings  and  to  the  pre-operative  pathology  report.  The  collect¬ 
ed  radio-frequency  (RE)  data  was  used  offline  to  recreate 
classic  B-mode  grey-scale  images,  and  also  to  compute  elas- 
tograms  showing  the  stiffness  of  the  tissue  scanned  [27,28]. 


Right 


Urethra 


Left 


Figure  4.  Ultrasound  elastography  data  collection  process  using 
the  sextant  approach;  RF  data  was  acquired  in  axial 
planes  (1-6)  from  the  gland's  base  towards  the  apex.  For 
illustration  purposes,  a  lesion  is  outlined  in  the  left  mid 
section,  peripheral  zone  of  the  specimen,  similar  with  the 
case  of  specimen  #3. 


USE,  the  prostate  specimens  were  placed  in  prone  position 
on  a  surgical  table.  USE  scans  were  performed  in  a  system¬ 
atic  sextant  approach,  similar  to  that  used  for  image  guided 
biopsies.  RF  data  was  acquired  in  axial  planes  (from  gland’s 
base,  through  mid  gland,  to  apex)  on  the  left  and  right  side 
of  the  gland  (Figure  4) .  The  sextant  approach  was  neces¬ 
sary  to  ensure  that  the  scans  were  in  the  same  plane  with  the 
histopathology  diagrams  (axial)  which  constituted  the  gold 
standard  for  comparison.  USE  coronal  scans  from  the  left 
to  the  right  of  the  gland  were  also  performed;  these  scans 
were  in  alignment  with  the  MR  coronal  scans. 

Hardware  and  software  specification 


Pre-operative  and  post-operative  MR  scans  were  used  for  an-  For  the  second  study,  USE  acquisition  was  conducted  using 
atomical  correlation  with  the  computed  elastograms.  For  a  Siemens  Antares  US  scanner  (Siemens  Medical  Solutions 
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15  Figure  5.  Axial  section  of  prostate  specimen  #1  peripheral  zone.  Left  lateral  section  of  the  prostate's  base;  classic  ultrasound  B-mode  (A)  and 

elastogram  (B).  Hard  lesion  is  outlined,  arrows  point  to  adjacent  nodule.  (C)  Hematoxylin  &  eosin  stained  histological  section  of  prostate 
base.  The  tumor  (Gleason  score  3+5=8,  outlined  in  black)  extended  beyond  the  prostatic  capsule  in  this  section  and  invaded  the  left 
seminal  vesicle  (arrow). 
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Table  1.  Table  summarizing  the  experimental  results  of  the  palpation 
study:  sensitivity  and  specificity. 


Manual 

palpation 

Ultrasound 

elastography 

Sensitivity 

66% 

84% 

Specificity 

67% 

71% 

Detection  rate  <20  mm  depth 

80% 

68% 

Detection  rate  >20  mm  depth 

0% 

66% 

Detection  rate 

80% 

84% 

USA,  Inc.  Ultrasound  Division,  Issaquah,  WA)  with  an  ultra¬ 
sound  research  interface  to  access  raw  RF  data.  Data  was  ac- 
40  quired  by  manual  handling  using  a  Siemens  VF  10-5  linear 
array  for  prostate  specimens.  After  RF  data  collection,  elas- 
tograms  were  obtained  using  the  dynamic  programming 
(DP)  elastography  algorithm  developed  in  our  lab  [27,28] . 

45  Each  prostate  specimen  underwent  routine  pathologic  pro¬ 
cessing  and  analysis.  Due  to  the  high  volume  of  prostatecto¬ 
mies  performed  at  our  institution,  the  routine  pathological 
process  does  not  result  in  a  whole  mount  mapping.  Instead, 
for  histopathological  evaluation  the  prostatectomy  speci- 
50  mens  were  initially  sliced  at  every  3-4  mm  from  apex  to 
base,  according  to  the  Stanford  protocol.  Each  slice  (6  to 
10  master  slices)  were  then  incorporated  in  a  paraffin  block 
and  sliced  at  5  p  meter  thickness.  The  slices  were  stained 
with  hematoxylin-eosin  and  were  then  analyzed  under  a  mi- 
55  croscope  by  a  pathologist  blinded  to  the  surgeon’s  hndings 
and  also  to  the  elastography  results.  The  localization  and 
size  of  each  tumor  focus  were  documented  for  all  step  mas¬ 
ter  slices  on  axial  diagrams,  with  Gleason  score.  Large  mac¬ 
ro  photographs  were  reconstructed  in  several  specimens 
60  (Eigure  5C) .  All  data  collected  were  stored  in  the  database. 

N=10  target  areas  were  analyzed  from  N=6  patients  enrolled 
63  so  far  into  the  elastography  analysis.  Histological  findings 
served  as  the  gold  standard  in  determining  the  presence. 


location  and  size  of  any  prostatic  nodules,  malignant  and 
benign.  The  objective  of  our  study  was  then  to  compare  axi¬ 
al  elastograms  findings  with  the  histological  findings  record¬ 
ed  by  the  pathologist  (mapping  diagrams,  measurements 
and  nodule  characteristics  such  as  malignant  vs.  benign) .  25 

Since  histopathology  diagrams  often  specified  just  the  max¬ 
imum  diameter  of  a  lesion,  coronal  elastograms  were  used 
to  better  establish  the  location  and  extent  of  the  identified 
lesions.  MRI  images  (both  axial  and  coronal  planes)  were 
aligned  to  the  elastograms  and  provided  help  with  their  30 
anatomical  co-registration  using  anatomical  details  such  as 
urethra  or  boundaries  of  peripheral  zone  vs.  central  gland. 


Results 

Comparative  study  for  tumor  detection 


35 


Overall  sensitivity  and  specificity  results  are  summarized  in 
Table  1.  USE  showed  higher  accuracy  in  tumor  detection 
with  a  sensitivity  of  84%  and  specificity  of  71%,  compared  40 
to  a  sensitivity  of  66%  and  a  specificity  of  67%  for  manual 
palpation.  At  depths  greater  than  20  mm,  no  subject  was 
able  to  identify  a  lesion  by  manual  palpation.  66%  of  these 
lesions  were  correctly  identified  on  elastograms. 

45 

Diameter  estimation  for  synthetic  phantoms  using  manual 
palpation  was  less  accurate  than  USE  (p=0.001)  with  a  root 
mean  squared  error  of  estimation  (RMSE)  of  4.81  for  man¬ 
ual  palpation  (95%  Cl  between  3.83  and  5.78),  versus  mean 
RMSE=3.02  for  USE  (95%  Cl  between  2.57  and  3.47) .  For  50 
vivo  phantoms,  estimations  were  comparable  in  both  manu¬ 
al  palpation  and  USE,  at  a  RMSE  of  about  11.0  mm.  Depth 
estimation  for  synthetic  phantoms  was  statistically  higher  us¬ 
ing  manual  palpation  than  USE  (p=0.0001)  with  a  mean  val¬ 
ue  of  the  RMSE  of  8.81  for  manual  palpation  (95%  Cl  be-  55 
tween  6.24  and  11.39)  versus  a  mean  value  of  the  RMSE=3.02 
for  USE  (95%  Cl  between  2.42  and  3.63)  -  Eigure  4.  Eor  ex- 
vivo  phantoms,  estimations  were  comparable  again  for  both 
manual  palpation  and  USE,  at  a  RMSE  of  about  1.0  mm. 

60 

Ex-vivo  human  prostate  study 

Elastography  identified  N=10  lesions,  8  hard  nodules  in  the  63 
peripheral  zone,  1  hard  and  1  soft  nodule  in  the  central 
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Table  2.  Prostate  specimen  data:  A  total  of  10  (ten)  elastography  lesions  were  identified  in  6  (six)  patients' specimens  (8  malignant  and  2  benign). 


# 

Location 

Gleason 

score 

Size  (cm) 

Elastography 

Pathology 

MRI 

1.1 

PZ  base 

3+5 

1. 4x0.8 

1. 3x0.8 

1.3X1.1 

1.2 

CG  base 

N/A-Solid 

0.7x1. 1 

1. 0x1.0 

1. 0x1.1 

1.3 

CG  base 

N/A-Soft 

1. 1x0.8 

1. 0x1.0 

1. 0x0.9 

2.1 

PZ  base 

5+3 

3.0x1. 3 

2.4x1. 0 

2.0x1. 5 

3.1 

PZmid 

4+5 

2.4X0.8 

1. 9x1.0 

1.5X1.2 

4.1 

PZmid 

3+3 

1. 0x0.5 

0.5X0.4 

0.6X0.7 

4.2 

PZmid 

3+4 

1. 5x0.9 

1. 1x0.5 

1. 1x0.8 

5.1 

PZ  apex 

3+3 

0.5X0.6 

0.5X0.5 

0.6X0.6 

5.2 

PZ  apex 

4+3 

0.6x1. 0 

0.8X0.9 

0.9X0.9 

6.1 

PZ  base 

3+3 

0.7x1. 2 

0.7x1. 8 

0.7X0.7 

PZ  -  peripheral  zone;  CG  -  central  gland. 

Figure  6.  Coronal  section  of  prostate  specimen  #1 
at  the  level  of  the  central  gland.  Classic 
ultrasound  B-mode  (A)  and  elastogram 
(B).  9.4 Tesla  ex-vivo  (C)  and  3  Tesla  in- 
vivo  (D)  MRI  images  are  presented  in 
coronal  planes,  in  CCW  (counter  clock 
wise)  orientation  for  better  visualization 
of  the  correlation  between  USE  and  MRI 
of  the  specimen.  Benign  solid  (arrow) 
and  soft  (dashed  arrow)  nodules  and 
urethra  are  visible. 


gland  (Table  2).  Pathology  reports  showed  8  of  these  le¬ 
sions  as  malignant  and  2  as  benign.  Diameter  measure¬ 
ments  correlation  proved  difficult  because  of  the  inabili¬ 
ty  to  perfectly  register  the  three  investigative  modalities. 
USE  and  MRI  measurements  were  within  on  average  2.05 
mm  vs.  2.25  mm  of  the  diameters  measured  by  patholo¬ 
gy  (standard  deviation  of  1.9  mm  for  USE  and  2.9  mm  for 
MRI).  Size  measurements  and  Gleason  score  are  report¬ 
ed  in  Table  1 . 

Specimen  #1  presented  multiple  hard  and  soft  lesions,  lo¬ 
cated  in  the  central  gland  of  the  prostate  (Figure  6) .  The 
ex-vivo  T2-weighted  coronal  image  from  specimen  MRI 


obtained  at  9.4  Tesla  (Figure  6C)  -  here  in  counter  clock 
wise  orientation  for  better  visualization  of  the  correlation 
between  USE  and  MRI  of  the  specimen)  shows  detailed 
anatomy  of  the  heterogeneous  central  gland  with  a  solid 
benign  prostatic  hypertrophy  nodule  (BPH)  confirmed 
by  pathology.  Elastography  was  able  to  detect  this  solid 
nodule  despite  the  heterogeneity  of  the  prostate  (Figure 
6B)  -  solid  arrow,  whereas  the  lesion  was  not  clearly  iden¬ 
tified  by  gray  scale  ultrasound.  Ex-vivo  T2-weighted  9.4 
Tesla  coronal  image  from  specimen  MRI  also  shows  an  ad¬ 
ditional  soft  cystic  BPH  nodule  (dashed  arrow).  Urethra 
is  also  visible  on  the  elastogram,  as  well  as  MRI  exam  (la¬ 
beled  urethra). 
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Figure  7.  B-mode  image  (left)  and  elastogram  (right)  from  specimens  #  2-6.  Dark  regions  at  the  very  bottom  of  elastograms  represent  structures 
outside  the  prostate  tissue  (e.g.  operating  table).  The  border  of  the  prostatic  tissue  can  be  easily  noticed  as  a  highly  reflective  band  at  the 
bottom  of  B-mode  images. 


30 


Axial  scans  of  the  same  specimens  were  compared  with  his- 
topathology  axial  cross-sections.  The  prostate,  submitted  for 
35  histological  processing  in  four  quadrant  sections  per  slice, 
was  digitally  realigned  to  reconstruct  a  full  histological  cross- 
section  (Figure  5C).  Specimen  #1  was  found  with  a  tumor 
with  Gleason  score  of  8  at  the  prostate  base,  left  side  (out¬ 
lined)  .  Figure  5A  shows  an  ultrasound  B-mode  image  and 
40  an  elastogram  obtained  through  an  axial  plane  at  the  pros¬ 
tate’s  base  on  the  left  side.  The  same  tumor  was  identified 
by  elastography  (Figure  5B  -  dashed  contour)  but  is  not 
visible  on  grey-scale  ultrasound.  For  an  anatomical  corre¬ 
lation,  a  soft  -  cystic  nodule  anterior  to  cancer  can  be  seen 
45  on  B-mode  image  and  USE  (Figure  5A,B  -  arrows)  and  on 
histopathology  (Figure  5C  -  arrows) . 

The  remaining  5  (five)  prostate  specimens  presented  with 
superhcial  lesions  in  the  peripheral  zone  of  the  gland.  USE 
50  identified  multiple  hard  malignant  lesions  in  various  loca¬ 
tions,  from  the  base  to  the  apex  of  the  prostate  gland.  One 
can  notice  the  clear  delimitations  of  these  lesions  on  USE 
(Figure  7)  as  well  as  the  close  estimations  of  size  versus  pa¬ 
thology  and  MRI. 

55 

Discussion 


In  surgical  procedures  where  manual  palpation  would  be 
helpful  but  not  possible  to  perform,  e.  g.  laparoscopic  robot- 
60  ic  surgery,  USE  can  offer  added  value  if  proven  to  be  accu¬ 
rate  in  detecting  pathologic  lesions.  Our  comparative  study 
showed  USE  to  be  superior  to  manual  palpation  in  general 
63  sensitivity  and  specificity,  and  also  in  identifying  deeper  le¬ 
sions.  Despite  of  the  inexperience  of  our  subjects  with  USE 


and  elastogram  evaluation,  USE  demonstrated  good  perfor¬ 
mance  in  detection  of  hard  lesions.  This  is  particularly  im¬ 
portant  as  surgeons  can  be  considered  inexperienced  elasto-  35 
gram  readers  as  well.  Our  feasibility  study  showed  that  USE 
was  able  to  identify  both  hard  and  soft  lesions  in  the  ex-vivo 
prostate  specimens,  located  in  the  deep  prostatic  central 
gland  and  in  the  peripheral  zone.  Histopathologic  hndings 
validated  USE,  and  results  compared  favorably  with  the  in-  40 
vivo  pre-surgical  and  ex-vivo  post-surgical  MRI  scans.  In  the 
central  gland  of  the  prostate,  elastography  showed  excel¬ 
lent  detection  of  hard  and  soft  areas,  despite  the  complex¬ 
ity  of  the  central  gland.  Elastography  was  able  to  identify 
both  hard  and  soft  BPH  nodules  and  anatomical  landmarks  45 
like  the  urethra  (note  excellent  anatomical  correlation  to 
MR  scan  findings) .  In  the  peripheral  zone  USE  identified 
multiple  hard  malignant  lesions,  from  the  base  to  the  apex 
of  the  prostate  gland.  These  preliminary  results  demon¬ 
strate  the  ability  of  USE  to  detect  hard  nodules  in  the  pros-  50 
tate  and  are  encouraging  in  the  pursuit  of  this  technology 
as  a  palpation  equivalent  imaging  tool  for  prostatectomy. 

USE  maps  tissue  elasticity  which  makes  it  an  ideal  imaging 
modality  to  serve  as  a  surrogate  and  possible  equivalence  to  55 
manual  palpation  in  identifying  hard  cancerous  tissue  in  the 
prostate  gland,  especially  in  the  peripheral  zone  but  also  in 
the  central  gland.  Real-time  intra-operative  imaging  guid¬ 
ance  is  needed  for  identifying  the  presence  of  cancer  with¬ 
in  the  prostate,  especially  near  the  capsule  where  tumor  can  60 
invade  and  spread  outside  of  the  gland,  and  also  for  study¬ 
ing  surrounding  structures.  If  diseased  hard  lymph  nodes 
could  be  detected,  then  lymphadenectomy  may  provide  a  63 
more  accurate  cancer  staging,  help  tailor  future  therapy. 
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and  potentially  prevent  recurrence.  A  better  delineation 
of  the  bladder  neck  and  apex  during  dissection,  especially 
when  prostate  cancer  is  located  at  the  apex  could  perhaps 
improve  patients’  outcome.  If  deemed  possible,  imaging  cav¬ 
ernous  nerves  (CNs)  located  along  the  immediate  surface 
of  the  prostate  gland  may  lead  to  their  preservation,  and 
thus  improved  preservation  of  potency  and  urinary  conti¬ 
nence  [29] .  Further  more,  the  development  of  the  elastog- 
raphy  technology  as  an  imaging  guiding  tool  during  prosta¬ 
tectomy  could  potentially  be  useful  in  the  open  procedures 
as  well,  where  the  manual  palpation  would  not  be  enough 
to  identify  deeper  lesions.  It  has  been  documented  in  the 
literature  that  prostate  carcinoma  originates  in  the  central 
gland  and  transitional  zone  in  up  to  30%  of  cases  [30,31]. 

Conclusions 


Our  initial  experience  showed  USE  was  able  to  reliably  iden¬ 
tify  hard  nodules  in  the  peripheral  zone  of  the  prostate  that 
were  prostate  cancers.  Additionally,  USE  showed  its  ability 
to  dehne  tissue  hardness  of  BPH  nodules  despite  the  un¬ 
derlying  tissue  complexity  in  the  central  gland.  Our  com¬ 
parative  study  demonstrated  USE  can  approach  the  effica¬ 
cy  of  manual  palpation  for  superficial  lesions  and  has  the 
potential  to  surpass  it  for  smaller,  deeper  lesions.  We  em¬ 
ployed  a  laparoscopic  ultrasound  probe  which  was  success¬ 
fully  used  and  tested  in  conjunction  with  elastography  al¬ 
gorithms.  Our  initial  experience  with  USE  encourages  us 
to  pursue  further  the  evaluation  of  this  technique.  Further 
testing  of  the  laparoscopic  probe  is  needed  in  a  real  lapa¬ 
roscopic  environment.  We  can  conclude  that  there  is  prom¬ 
ise  is  integrating  laparoscopic  ultrasound  elastography  as 
a  real-time,  in-vivo  imaging  tool  to  guide  surgeons  during 
robotic-assisted  prostatectomies. 
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Abstract.  Panoramic  ultrasound  imaging  is  emerging  as  a  prevalent 
technique  in  clinical  practice  with  a  high  clinical  value.  In  the  literature 
of  ultrasound  mosaicing,  registering  the  underlying  displacement  field 
for  elastography  has  not  yet  been  addressed.  The  clinical  advantages  of 
ultrasound  mosaics  can  be  improved  with  the  additional  corresponding 
strain  information.  In  this  paper,  we  propose  a  technique  for  generat¬ 
ing  a  reliable,  wide  field-of-view  displacement  field,  robust  to  sources 
of  decorrelation.  Elastography  mosaics  are  generated  from  two  pairs  of 
ultrasound  images,  and  then  from  multiple  image  pairs.  Experimental 
phantom  data  is  used  for  the  validation  of  the  multi-image  elastography 
mosaic.  Einally,  the  method  is  extended  to  multiple  3D  volume  pairs. 


1  Introduction 

Compared  to  other  imaging  modalities  like  CT  and  MR,  ultrasound  suffers  from 
a  limited  field  of  view.  Monitoring  a  structure  can  be  particularly  challeng¬ 
ing  when  it  is  too  large  to  be  visualized  in  a  single  image  or  3D  sweep.  Size 
and  distance  measurements  are  unreliable  in  large  organs.  Panoramic  imaging  is 
emerging  as  a  prevalent  technique  used  in  widening  the  field  of  view  (FOV)  of 
medical  ultrasound  images.  Also  referred  to  as  stitching  or  panorama,  the  ultra¬ 
sound  mosaic  aims  to  achieve  several  clinical  advantages  which  come  along  with 
extended  FOV:  1)  improving  the  understanding  of  spatial  relationships  among 
structures  when  the  size  of  a  single  image/volume  is  not  large  enough  to  cover 
the  entire  area,  2)  allowing  for  measurements  of  size  and  distance  in  large  organs 
and  lesions,  3)  allowing  multi-modal  registration  and  fusion  with  pre-operative 
data  for  guidance  in  minimally-invasive  interventions. 

Ultrasound  elastography  is  a  technique  first  proposed  two  decades  ago  by  [1] 
for  the  clinical  imaging  of  tissue  stiffness.  Numerous  clinical  applications  have 
been  investigated,  among  them  cancer  imaging  [1],  ablation  monitoring  [2],  and 
the  detection  and  grading  of  deep  vein  thrombosis  [3].  In  this  work  we  focus  on 
extended  FOV  displacement  estimation  for  quasi-static  ultrasound  elastography. 
The  tissue  is  imaged  while  it  is  slowly  deformed  using  an  external  mechanical 
force  and  the  images  are  used  for  the  estimation  of  tissue  motion  or  displacement 
[1].  Elastography  maps  the  mechanical  properties  of  tissue  which  can  add  valu¬ 
able  features  to  the  B-mode  panorama.  Many  clinical  applications  deal  with  large 
cancerous  lesions  which  expand  beyond  the  span  of  l(one)  ultrasound  image  [4]. 
An  ultrasound  elastography  mosaic  can  improve  the  understanding  of  the  size  of 
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the  lesion  and  its  layout  among  surrounding  structures.  In  the  ablation  of  hep¬ 
atic  cancerous  tissue,  the  size  of  the  HIFU-induced  ablative  lesions  often  exceeds 
4  cm  in  diameter,  which  is  the  width  of  a  typical  ultrasound  transducer.  Ther¬ 
mal  lesions  are  not  visible  in  conventional  B-mode  ultrasound  but  a  panoramic 
ultrasound  elastogram  can  help  visualize  the  entire  extent  of  the  ablation  [2], 
monitoring  and  insuring  all  cancerous  tissue  is  ablated.  In  the  assessment  of  ve¬ 
nous  thrombi,  a  combination  of  ultrasound  B-mode  and  Doppler  imaging  help 
detect  the  presence  of  the  blood  clot,  but  it  is  elastography  which  can  provide 
its  age  and  clinical  grading  [3].  An  in-plane  ultrasound  elastography  mosaic  can 
provide  mapping  of  the  thrombi  all  along  the  femoral  vein.  It  could  take  up  to 
eight  mosaiced  volumes  to  depict  an  entire  organ  like  the  liver  or  kidney  [5] ,  but 
having  the  corresponding  elastography  mosaic  would  allow  for  registration  with 
pre-operative  imaging  data  (CT  or  MRI)  which  would  help  with  intra-operative 
navigation.  Although  the  basics  of  medical  elastography  have  long  been  defined, 
new  clinical  applications  are  constantly  emerging  are  we  are  seeing  an  increasing 
commercial  and  clinical  interest. 

Multiple  approaches  have  been  published  in  the  literature  on  2D  and  3D  wide 
FOV  ultrasound  mosaics  [6,5,7,  8],  but  very  little  of  it  concerns  registering  the 
underlying  strain  field.  As  various  sources  of  decorrelation  are  usually  affecting 
the  computation  of  strain  images,  this  problem  becomes  even  more  important 
when  attempting  to  generate  a  unified,  wide  displacement  field.  Further  more, 
most  elastography  algorithms  result  in  qualitative  strain;  2  image  pairs  with 
even  very  slightly  different  degrees  of  compression  will  produce  2  strain  images 
in  which  different  structures  could  be  visible.  Another  problem  rises  in  the  ambi¬ 
guity  of  the  interpretation  of  strain  images:  low  strain  can  be  indicative  of  high 
stiffness  but  this  interpretation  may  not  be  the  right  one  if  the  stress  field  is  not 
uniform  throughout  the  tissue  [1,9].  To  address  these  issues  and  to  improve  the 
quality  of  strain  images,  several  metrics  of  stability,  consistency /persistency  and 
reliability  have  been  developed  [10-12].  In  these  paper  we  propose  using  similar 
techniques  to  select  a  stable  pair  of  RF-lines  which  will  become  the  seed  for  gen¬ 
erating  a  reliable,  wide  FOV  displacement  field.  Displacement  on  the  seed  line 
is  calculated  using  dynamic  programming  and  later  propagated  in  both  lateral 
directions  of  the  mosaic  using  an  analytic  minimization  approach  [13].  Each  new 
image  pair  adds  to  the  unified  displacement  field.  Experimental  phantom  data 
is  used  for  the  validation  of  the  multi- image  elastography  mosaic.  Finally,  the 
method  is  extended  to  3D  ultrasound  elastography  mosaicing  using  multiple  3D 
volume  pairs. 

2  Methodology 

Consider  a  sequence  of  radio  frequency  (RF)  data  (/mu,  Imi2)  collected  at 
position  to,  before  and  after  the  compression  of  tissue  using  a  2D  ultrasound 
transducer  (Fig.  lb).  Each  sequence  is  contains  n  RF-lines  of  length  m.  A  second 
sequence  (/m2i,  1^22)  is  collected  (Fig.  Ic)  after  the  transducer  has  been  moved 
in  the  lateral  direction  of  the  probe  to  position  ti,  with  the  help  of  a  moving  stage 
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(Fig.  la).  A  vertical  stage  was  used  to  achieve  an  almost  identical  compression 
rate  between  the  two  sequences.  The  translation  between  the  2  image  sequences 
is: 

T^lines  ~  ^mm  *  Tljw  (1) 

where  w  is  the  width  of  the  ultrasound  transducer  in  millimeters  (mm),  n  is 
the  number  of  RF-lines,  is  the  ground  truth  translation  in  mm  as  read  on 
the  stage  and  Tunes  is  the  corresponding  translation  as  number  of  RF-lines.  The 
overlap  area  consists  of  {n  -  Tunes)  RF-lines  (Fig.  Id). 


Fig.  1.  Experimental  setup  (a).  Bmode  ultrasound  data  before  and  after  compression 
for  (b)  position  to,  and  (c)  position  ti.  Translation  Tunes  and  the  length  of  the  overlap 
area  are  shown  in  (d). 


Pairwise  Mosaicing  In  Analytic  Minimization  (AM)  elastography  [13],  2D 
integer  displacements  are  first  obtained  using  dynamic  programming  (DP)  on  a 
single  pair  of  RF-lines  and  are  later  propagated  to  produce  2D  subsample  dis¬ 
placements  for  the  entire  image.  We  aim  to  find  a  robust  and  stable  seed  RF-line 
in  the  overlap  area,  which  also  gives  consistent  DP  integer  displacement  results 
in  the  two  sequences.  This  RF-line  will  serve  as  initial  guess  in  the  AM  propa¬ 
gation.  The  selection  of  the  most  stable,  optimal  seed  RF-line  is  implemented  as 
follows: 

1.  /c  =  10  (ii,  ^2,  •••,  Uo)  random  corresponding  positions  (RF-line  pairs)  are 
selected  from  the  overlap  area  (Fig.  2-1). 

2.  Compute  integer  axial  displacement  for  each  RF-line  pair:  (aj,  a^, ajo) 
and  (a^,  al, a^g)  (Fig.  2-2).  Note:  in  this  step,  both  axial  and  later  integer 
displacements  are  computed,  but  from  here  on  only  axial  displacement  values 
will  be  used. 

3.  A  stability  test  identifies  and  removes  RF-lines  which  exhibit  a  high  degree 
of  decorrelation.  The  test  is  considered  positive  when  the  three  or  more 
positions  exhibit  a  continuous  change  in  the  slope  of  displacement  (Fig.  2-3) 
[12]. 
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4.  For  the  remaining  positions, 

dk  =  abs{al.  —  of,);  avgk  =  mean{dk)]  stdk  =  stdev{dk)  (2) 

We  select  the  seed  RF-line  s  as  the  position  with  the  minimum  stdk  and 
avgk  <  1  (Fig.  2-4). 

5.  Subinteger  displacement  values  are  calculated  for  RF-line  s  in  one  of  the 
image  pairs.  In  the  Analytic  Minimization  (AM)  method  [13]  we  aim  to 
calculate  Aai  and  Ali  such  that  the  duple  (a^  +  Z\a^,  k  +  Ali)  gives  the  axial 
and  lateral  displacements  at  the  sample  i.  For  A  and  I2  two  ultrasound 
images  acquired  before  and  after  deformation,  the  regularized  cost  function 
at  the  ith  sample  of  the  jth  RF-line  follows  (Fig.  2-5): 

Cj(^A(i\^ ...,  AcLfYi^  ■A/i, ...,  AljYi)  — 

=  Sm  ^{[^l(bi)  —  +  AliY^  +  z^) 

-\-c^  (ai  Aai  ~  1  ~  Aai—i)  -\- 

+/^a  {h  +  Ali  ~  h-i  ~  Ali-i)  -h  f3i  (li  -j-  Ali  ~  hj-i) 

where  the  index  j  was  dropped  for  the  RF-line  and  kj-i  is  the  lat¬ 
eral  displacement  of  the  previous  RF-line  (except  for  the  seed  line  where 
hj-i  =  li-  OL^Pa  and  Pi  are  regularization  terms  which  ensure  continuity  in 
displacements  with  respect  to  the  top  (axial  a),  and  the  top  and  left/right 
(lateral  pa  and  Pi). 

6.  The  subinteger  displacement  values  are  propagated  using  AM: 

—  in  one  sequence  towards  the  first  RF-line,  and 

—  in  the  second  sequence  towards  the  last  RF-line. 

The  unified  displacement  field  will  have  n  -h  Tu^es  RF-lines  and  the  stitch 
will  be  around  RF-line  number  s  +  Tunes  (Fig.  2-6). 

7.  Generate  the  ultrasound  elastography  mosaic  from  the  unified  displacement 
field  (Fig.  2-7). 


Multi- image  Mosaicing  Given  an  existing  rit  wide  displacement  map,  com¬ 
puted  for  image  pairs  1  through  t,  we  expand  our  displacement  map  to  include 
information  from  image  pair  t  +  1  as  follows: 


1. 

2. 

3. 


4. 


Gompute  the  translation  between  position  t  and  position  t  + 1  and  the 

overlap  area. 

Follow  steps  1-4  from  above  to  select  the  seed  RF-line  St+i. 

Use  the  subinteger  values  form  the  wide  FOV  displacement  map  at  RF-line 
number  5^+1  +  Tunes  as  seed  values  to  propagate  using  AM: 

—  in  the  new  sequence  towards  the  first  RF-line. 

Stitch  the  newly  computed  (s^+i  +  Tunes)  lines  at  the  beginning  of  the 
previous  displacement  map.  The  new  mosaiced  displacement  field  will  have 
RF-lines. 

Generate  the  new  ultrasound  elastography  mosaic  from  the  updated  dis¬ 
placement  field. 
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Select  k“10position$(TRF-lme»)  Confute  integer  displacements  After  stability  test  ieedRF-line  s 


1)  2)  3)  4) 


Subinteger  displacement  Displacement  propagation 


Stitching 


Elastography  mosaic 


Fig.  2.  Pairwise  Mosaicing  workflow:  k  =  10  random  RF  positions  are  selected  (1), 
integer  displacement  is  calculated  for  each  position  (2),  some  positions  are  identified 
and  removed  after  stability  test  (3),  the  seed  RF-line  s  is  selected  (4),  subinteger 
displacement  values  are  calculated  for  s  (5),  propagated  in  the  2  sequences  and  stitched 
(6).  The  ultrasound  elastography  mosaic  is  generated  from  the  displacement  field  (7). 


3  Results  and  Validation 


For  experimental  validation  we  palpated  a  CIRS  (Norfolk,  VA)  elastography 
049a  elastography  phantom  (Fig.  Ic)  using  a  high-frequency  ultrasound  trans¬ 
ducer  (L14-5W/60)  at  center  frequency  of  10  MHz.  Ultrasound  RF  data  was 
acquired  from  an  Ultrasonix  system  (Vancouver,  BC)  at  40MHz  sampling  rate. 
The  049a  phantom  consists  of  a  series  of  stepped  cylinders  of  varying  diameters. 
The  transducer  was  placed  on  top  of  one  of  the  cylinders,  parallel  with  its  di¬ 
rection.  The  phantom  was  placed  on  a  stage  which  controlled  the  compression 
in  the  axial  direction  and  the  translation  in  the  lateral  direction  (Fig.  Ic).  RF 
data  sequences  were  acquired  from  4(four)  axial  compression  levels  (cq  =  0,  ci 
=  2.54mm,  C2  =  5.08mm,  cs  =  back  to  0),  for  each  of  4(four)  lateral  translation 
positions  of  the  transducer  (to  =  0,  ti  =  5.08mm,  t2  =  10.16mm,  =  20.32mm), 

for  a  total  of  16(sixteen)  data  sets.  The  width  of  the  ultrasound  transducer  L14- 
5W  is  59mm,  and  as  a  consequence  any  2  sets  separated  by  a  lateral  translation 
had  some  amount  of  overlap. 

Ultrasound  elastography  images  were  obtained  for  each  translation  position 
to  -  ts  ((Fig.  3a-d).  A  pairwise  elastography  mosaic  was  produced  from  positions 
to  and  ti  ((Fig.  3e),  and  then  multi-image  elastography  mosaics  from  positions 
to,  ti  and  t2  ((Fig.  3f),  and  to,  ti,  t2  and  ts  ((Fig.  3g). 


Fig.  3.  Ultrasound  elastography  at  position  to  (a),  ti  (b),  t2  (c),  ts  (d)  and  elastography 
mosaic  of  positions  to  and  ti  (e),  to,  ti  and  t2  (f),  and  to,  ti,  t2  and  ts  (g). 

Mosaicing  multiple  images  in  a  pairwise  fashion  can  cause  errors  to  accu¬ 
mulate  with  each  new  added  image.  To  calculate  this  error  we  computed  the 
wide  FOV  displacement  map  from  positions  to  and  ts,  and  compared  it  with  the 
multi-image  displacement  map  from  positions  to,  ti,  t2  and  ts  added  consecu¬ 
tively.  The  random  search  algorithm  was  run  5  times  and  the  results  averaged. 
For  the  resulting  displacement  maps,  we  computed  an  absolute  difference  per 
pixel,  as  well  as  mean  and  standard  deviation  absolute  difference  for  the  entire 
FOV. 


(d) 


(e) 


(f) 


Fig.  4.  Panoramic  displacement  map  of  positions  to  and  ts  (a),  and  of  positions  to,  ti, 
t2  and  ts  (b) ,  the  absolute  difference  between  them  (c) ,  and  the  mean  and  standard  de¬ 
viation  of  this  difference,  per  line  (d).  The  unit  of  displacement  is  pixels.  Corresponding 
ultrasound  elastography  mosaics  of  positions  to  and  ts  (e),  and  to,  ti,  t2  and  ts  (f). 


Figure  4  shows  the  results  of  the  validation  experiment.  The  two  panoramic 
displacement  maps  agree  almost  exactly;  the  absolute  difference  for  the  entire 
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image  had  a  mean  of  0.0755  and  a  standard  deviation  of  0.2386  pixels.  The 
maximum  difference  was  2.0168  pixels  and  it  did  not  exceed  1  pixel  on  a  mean, 
per-line  basis.  For  a  metric  correspondent,  2.0168  pixels,  is  the  equivalent  of 
0.0406  mm  in  the  axial  direction.  Once  the  displacement  maps  are  converted  in 
elastogram  mosaics  (Fig.  4  e,f),  the  difference  becomes  indistinguishable  even  on 
close  inspection.  With  the  clinical  application  in  mind,  we  conclude  that  these 
small  differences  are  acceptable. 

4  3D  mosaicing 

For  3D  validation,  RF  data  was  acquired  using  an  Ultrasonix  system  (Vancou¬ 
ver,  BC)  at  20MHz  sampling  rate.  The  CIRS  phantom  was  palpated  with  a 
38mm  width  linear  4D  volumetric  transducer  (4DL14-5/38).  As  with  the  2D 
experiment,  the  phantom  was  placed  on  a  stage  to  controll  the  compression  in 
the  axial  direction  and  the  translation  in  the  lateral  direction  (Fig.  Ic).  RF  data 
sequences  were  acquired  from  4(four)  axial  compression  levels  (cq  =  0,  ci  = 
2.54mm,  C2  =  5.08mm,  cs  =  back  to  0),  for  each  of  5(five)  lateral  translation 
positions  of  the  transducer  (to  =  0,  ti  =  5.08mm,  t2  =  10.16mm,  ts  =  20.32mm, 
t4  =  22.86mm),  for  a  total  of  20(twenty)  data  sets.  Figure  5  shows  the  results. 


Fig.  5.  3D  ultrasound  elastography  mosaic:  axial-lateral  plane  (a),  lateral-elevational 
plane  (b),  and  3  axial- ele vat ional  planes  through  3  different  diameters  of  the  stepped 
cylinder  (d) 


5  Discussion  and  Conclusion 

We  have  presented  an  algorithm  for  generating  reliable  multi-image  ultrasound 
elastography  mosaics,  robust  to  regions  of  decorrelation.  Panoramic  B-mode  ul¬ 
trasound  has  been  reported  with  success  in  the  literature  and,  with  the  addition 
of  corresponding  elastograms,  an  ultrasound  system  with  these  capabilities  has 
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great  potential  in  clinical  diagnostic  and  monitoring.  Elastography  has  the  ad¬ 
vantage  that  is  requires  no  additional  hardware  to  be  implemented,  and  a  ma¬ 
jority  of  commercial  ultrasound  systems  now  present  an  elastography  interface. 
Furthermore,  efforts  are  under  way  to  incorporate  electromagnetical  (EM)  track¬ 
ing  in  ultrasound  transducers.  The  work  presented  here  makes  a  case  for  in-plane 
mosaicing  where  translation  is  the  only  component  of  the  transformation.  One 
can  easily  envision  an  ultrasound  system  equipped  with  a  tracked  transducer, 
where  RE  frames  can  be  tracked  and,  based  on  their  position,  suitable  frames 
can  be  selected  for  elastography  [14],  as  well  as  for  elastography  mosaics. 

References 

1.  Ophir,  J.,  Alam,  S.K.,  Garra,  B.,  Kallel,  F.,  Konofagou,  E.,  Krouskop,  T.,  Varghese, 
T.:  Elastography:  ultrasonic  estimation  and  imaging  of  the  elastic  properties  of 
tissues.  Proceedings  of  the  Institution  of  Mechanical  Engineers.  Part  H,  Journal 
of  Engineering  in  Medicine  213(3)  (1999)  203-233 

2.  Varghese,  T.,  Zagzebski,  J.,  Lee  Jr.,  F.:  Elastographic  imaging  of  thermal  lesions  in 
the  liver  in  vivo  following  radiofrequency  ablation:  preliminary  results.  Ultrasound 
in  Medicine  V  Biology  28(1112)  (December  2002)  1467-1473 

3.  Emelianov,  S.,  Chen,  X.,  ODonnell,  M.,  Knipp,  B.,  Myers,  D.,  Wakefield,  T.,  Ru¬ 
bin,  J.:  Triplex  ultrasound:  elasticity  imaging  to  age  deep  venous  thrombosis. 
Ultrasound  in  Medicine  V  Biology  28(6)  (June  2002)  757-767 

4.  Garra,  B.,  Cespedes,  E.,  Ophir,  J.,  Spratt,  S.,  Zuurbier,  R.,  Magnant,  C.,  Pennanen, 
M.:  Elastography  of  breast  lesions:  initial  clinical  results.  Radiology  202(1)  (1997) 
79-86 

5.  Poon,  T.C.,  Rohling,  R.N.:  Three-dimensional  extended  field-of-view  ultrasound. 
Ultrasound  in  Medicine  &  Biology  32(3)  (March  2006)  357-369 

6.  Gee,  A.H.,  Treece,  G.M.,  Prager,  R.W.,  Cash,  C.J.,  Berman,  L.:  Rapid  registration 
for  wide  field  of  view  freehand  three-dimensional  ultrasound.  IEEE  Transactions 
on  Medical  Imaging  22(11)  (November  2003)  1344-1357 

7.  Wachinger,  C.,  Wein,  W.,  Navab,  N.:  Registration  strategies  and  similarity  mea¬ 
sures  for  three-dimensional  ultrasound  mosaicing.  Academic  Radiology  15(11) 
(November  2008)  1404-1415 

8.  Rajpoot,  K.,  Noble,  J.A.,  Grau,  V.,  Szmigielski,  C.,  Becher,  H.:  Multiview  RT3D 
echocardiography  image  fusion.  In  Ayache,  N.,  Delingette,  H.,  Sermesant,  M.,  eds.: 
Functional  Imaging  and  Modeling  of  the  Heart.  Volume  5528.  Springer  Berlin 
Heidelberg,  Berlin,  Heidelberg  (2009)  134-143 

9.  Lindop,  J.E.,  Treece,  G.M.,  Gee,  A.H.,  Prager,  R.W.:  3d  elastography  using  free¬ 
hand  ultrasound.  Ultrasound  in  Medicine  V  Biology  32(4)  (2006)  529  -  545 

10.  Jiang,  J.,  Hall,  T.J.,  Sommer,  A.M.:  A  novel  image  formation  method  for  ultrasonic 
strain  imaging.  Ultrasound  in  Medicine  V  Biology  33(4)  (2007)  643  -  652 

11.  Lindop,  J.,  Treece,  G.,  Gee,  A.,  Prager,  R.:  An  intelligent  interface  for  freehand 
strain  imaging.  Ultrasound  in  Medicine  V  Biology  34(7)  (2008)  1117  -  1128 

12.  Fleming,  L,  Rivaz,  H.,  Boctor,  E.,  Hager,  G.:  Robust  dynamic  programming 
method  for  ultrasound  elastography.  SPIE  8320(1)  (2012)  83201-83206 

13.  Rivaz,  H.,  Boctor,  E.,  Choti,  M.,  Hager,  G.:  Real-time  regularized  ultrasound 
elastography.  IEEE  Transactions  on  Medical  Imaging  30(4)  (April  2011)  928-945 

14.  Foroughi,  P.,  Rivaz,  H.,  Fleming,  I.N.,  Hager,  G.D.,  Boctor,  E.M.:  Tracked  ultra¬ 
sound  elastography  (true).  In:  Proceedings  of.  MICCAITO  (2010)  9-16 


